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from the CPU. This type of organization is called a memory hierarchy. In Figure 
1.6, a typical multilevel memory hierarchy is shown. Two important levels of 
the memory hierarchy are the cache and virtual memory. 

A cache is a small, fast memory located close to the CPU that holds the most 
recently accessed code or data. When the CPU does not find a data item it needs 
in the cache, a cache miss occurs, and the data is retrieved from main memory 
and put into the cache. This usually causes the CPU to pause until the data is 

Likewise, not all objects referenced by a program need to reside in main 
memory. If the computer has virtual memory, then some objects may reside on 
disk. The address space is usually broken into fixed-size blocks, called pages. At 
any time, each page resides either in main memory or on disk. When the CPU 
references an item within a page that is not present in the cache or main 
memory, a page fault occurs, and the entire page is moved from the disk to main 
memory. The cache and main memory have the same relationship as the main 
memory and disk. 
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FIGURE 1.7 The typical levels in the hierarchy slow down and get larger as we move away from the CPU. Sizes 
are typical for a large workstation or minicomputer. The access time is given in nanoseconds. Bandwidth is given , ir .MB 
per second, assuming 32-bit paths between levels in the memory hierarchy. As we move to lower levels of the hierarchy, 
the access times increase, making it feasible to manage the transfer less responsively. The values shown are typical in 
1990 and will no doubt change over time. 



Machine 
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Register 
access time 


Cache size 


Cache 
access time 


VAX- 11/780 


16 32-bit 


100 ns 


8KB 


200 ns 


VAXstation 
3100 


16 32-bit 


40 ns 


1 KB on chip, 
64 KB off chip 


125 ns 


DECstation 
3100 


32 32-bit integer; 
16 64-bit floating 
point 


30 ns 


64 KB instruction; 
64 KB data 


60 ns 



FIGURE 1 .8 Sizes and access times for the register and cache levels of *the 
hierarchy vary dramatically among three different machines. 



